Predictive scaling for clusters

ABSTRACT

A method for managing resources of clusters is disclosed. A computer retrieves data about an event and other data about past events. The computer selects a set of past events that are similar to the event, based on the data about the event and the other data about the past events. The computer then analyzes the data about the event and the other data about the past events associated with the set of past events to identify a portion of the resources of one or more of the clusters required for use by the event.

This application is a continuation of and claims the benefit of priorityto U.S. patent application Ser. No. 13/732,545, filed on Jan. 2, 2013,entitled “Predictive Scaling for Clusters”. The contents of which arehereby incorporated by reference

BACKGROUND OF THE INVENTION

1. Field of the Invention

The disclosure relates generally to using data processing systems forcluster resource management and, in particular, to managing allocationsof resources of clusters for events. Still more particularly, thepresent disclosure relates to using social data associated with eventsto improve the allocations of resources of clusters for events.

2. Description of the Related Art

As today's business needs are becoming more reliant on computer basedhardware and software solutions, the need for having fast, reliable, andlow cost solutions is more prevalent. Companies may use a portion ofresources of clusters of computers to host their solutions. Usingclusters to host solutions allows the companies to handle increasedglobal traffic while also providing failover to prevent loss of service.Scheduled events may increase user demand for these hosted solutions.

One way to manage availability of resources of clusters while alsokeeping costs down is to scale a number of nodes in a cluster based onuser demand. Current clustering products allow system administrators todefine conditions that trigger either an increase or decrease in thenumber of nodes in a cluster. These conditions for changing the numberof nodes in a cluster may be based on a time of day, week, month, orother schedule. However, allocating resources based on a schedule is atbest an educated guess based on past performance, not currentconditions. There is no guarantee that what has happened in the pastwill stay true for future events. This method also cannot take intoaccount special events that may skew demand for resources or causeunexpected spikes or drops in demand.

Conditions for triggering a change in the number of nodes in a clustermay also be based on a current utilization of cluster resources.However, conditional changes based on machine resource use are reactiveand thus may result in unsatisfying solution performance. For example,for solutions that can trigger quick increases in user participation,such as at the start of a meeting. In this example, there may not beenough time to reactively increase the number of nodes in a cluster, andthus the users may see response degradation.

Social networks have significantly enhanced information sharing over theInternet. Social networking sites, such as Facebook® and Twitter providecollaboration tools which allow users to interact with each other byexchanging messages with other computer users. Typical collaborationtools include tools for chatting, texting, instant messaging, multimediamessaging, emailing, conferencing, tweeting, and commenting.

Through the use of social networks users sometimes express interest andnon-interest in events. The expression of interest may be for aparticular event, for events of a particular type, and for topicsassociated with an event. For example, the expression of interest may beformed as a like or dislike. Using natural language processing,computational linguistics, and text analytics a computer system can minesource material of social networks to derive expressions of interestabout events. Currently however, there is no system or process availablefor using expressions of interests in events in social networks topredicatively scale resources of clusters for use by solutionsassociation with the events.

Therefore, it would be advantageous to have a method, data processingsystem, and computer program product that takes into account at leastsome of the issues discussed above, as well as possibly other issues.

SUMMARY

In one illustrative embodiment a method for managing resources ofclusters is disclosed. A data processing system retrieves data about anevent and other data about past events. The data processing systemselects a set of past events that are similar to the event, based on thedata about the event and the other data about the past events. The dataprocessing system then analyzes the data about the event and the otherdata about the past events associated with the set of past events toidentify a portion of the resources of one or more of the clustersrequired for use by the event.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a cluster resource management environmentfor managing resources of clusters in accordance with an illustrativeembodiment;

FIG. 2 is a block diagram of components involved in managing resourcesof clusters in a data processing system in a cluster resource managementsystem in accordance with an illustrative embodiment;

FIG. 3 is a flow chart of a process for managing allocations ofresources of clusters in accordance with an illustrative embodiment;

FIG. 4 is a flow chart of a process for managing re-allocations ofresources of clusters in accordance with an illustrative embodiment;

FIG. 5 is a flow chart of a process for managing allocations ofresources of clusters using preferences in accordance with anillustrative embodiment;

FIG. 6 is a flow chart of a process for powering up resources ofclusters for an event in accordance with an illustrative embodiment; and

FIG. 7 is an illustration of a data processing system in accordance withan illustrative embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent invention may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present invention are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

The illustrative embodiments recognize and take into account thatexisting web based applications are available for use by users of websites. Web based applications typically run on a web server. These webbased applications communicate with web browsers by generating web pagesand sending the web pages to a web browser. The generated web pages aretypically displayed on a display screen by a web browser running on acomputing device. For example, a web based application for a shoppingweb site may generate web pages for a sale. In this example, customersmay make selections for purchasing items made available to them duringthe sale. As another example, a collaboration web site may providecontent and applications for exchanging information with attendees of ameeting. In this example, attendees of the meeting may use theapplications to browse the content and to provide opinions about thecontent.

As used herein, the term “computing device” means a hardware device witha processor unit and a capability to display information on a displaydevice and may also include the capability to emit audio on a speaker.For example, the computing device may be a computer, a television with aprocessor unit, a smart phone, and any other suitable device.

The illustrative embodiments also recognize and take into account thatexisting web based applications are available for users of socialnetworking web sites to share expressions of interest and non-interestin events. As used herein, an expression of interest in an event mayinclude a like or a dislike, such as an indication that a user wouldlike to attend the event. The expression of interest may also be basedon a scale, such as percentage between 0 and 100. For example, a usermay identify a percent likelihood that they will attend an event. Inthis example 100% likelihood indicates the user will very likely attend,50% indicates there is a 50% chance the user will attend, and 0%indicates that the user, in all likelihood, will not attend.

The illustrative embodiments further recognize and take into accountthat existing sentiment analytics tools for performing natural languageprocessing, computational linguistics, and text analytics are availableto identify and extract subjective information in source materials.These sentiment analytics tools may be used to identify user sentimentabout aspects of entities associated with events from informationentered by users into social networks and collaboration tools.

The illustrative embodiments still further recognize, through the use ofcollaboration tools users sometimes express sentiments about featuresand aspects of entities that may be associated with events. As usedherein, an entity is something that exists by itself, although it neednot be of material existence. An entity is defined as a particular anddiscrete unit. For example, an entity may be a person, an organization,a thing, an abstract idea, a problem, a solution, and a particular typeof activity. The entities discussed may be particularly named events,persons, places, or things and sometimes may include unnamed entities.An aspect of an entity is an appearance of the entity to the eye ormind. Some aspects of entities include physical appearances such asthose based on sight, touch, smell, and other senses. Other aspects ofentities include descriptions of metaphysical concepts, such as anaspect of a particular philosophy. More particularly, entities may haveaspects that contrast one entity from other entities.

Thus, the different illustrative embodiments provide a method,apparatus, and computer program product to manage resources of clusters.For example, the different illustrative embodiments may use a processfor managing allocations of resources of a plurality of clusters ofcomputer systems. For example, a cluster resource management system mayretrieve data about an event and other data about past events. Thecluster resource management system may select a set of past events thatare similar to the event, based on the data about the event and theother data about the past events. The cluster resource management systemnext analyzes the data about the event and the other data about the pastevents associated with the set of past events to identify a portion ofthe resources of one or more of the clusters required for use by theevent. Responsive to identifying the portion of the resources of the oneor more of the clusters required for use by the event, the clusterresource management system then allocates the portion of the resourcesof the one or more of the clusters required for use by the event.

With reference now to the figures and, in particular, with reference toFIG. 1, a block diagram of a cluster resource management environment formanaging resources of clusters is depicted in accordance with anillustrative embodiment. In this illustrative example, cluster resourcemanagement environment 100 is depicted in block diagram form.

In these illustrative examples, users, such as user 101, may use clientapplications 105 running on computing devices such as client device 102within cluster resource management environment 100. Client applications105 running on client device 102 may take various forms. For example,client applications 105 may include at least one of web browser 106, acluster resource management application, a database application, asmart-phone application, and other suitable types of applications forcluster resource management environment 100. In these illustrativeexamples, web browser 106 may display information on a display screen ofclient device 102 and may also present information to user 101 by usinga speaker to emit audio.

As used herein, the phrase “at least one of”, when used with a list ofitems, means that different combinations of one or more of the listeditems may be used and only one of each item in the list may be needed.For example, “at least one of item A, item B, and item C” may include,for example, without limitation, item A, or item A and item B. Thisexample also may include item A, item B, and item C, or item B and itemC. In other examples, “at least one of may be, for example, withoutlimitation, two of item A, one of item B, and ten of item C; four ofitem B and seven of item C; and other suitable combinations.

As depicted, client device 102 communicates with cluster resourcemanagement system 110 over network 104. In these illustrative examples,user 101 may send event 108 to cluster resource management system 110for processing. In these illustrative examples, event 108 at leastincludes a start time and duration of the event, and an event typespecifying a purpose of the event. For example, event 108 may be a sale,a meeting, an election, a holiday, a group activity, and any other typeof occasion for which cluster resource management is useful. Event 108may also comprise an indication for repeating. For example, event 108may repeat based on a set of particular dates and on a cycle, such asdaily, weekly, monthly, quarterly, annually, and any other suitableschedule for events.

As also depicted, cluster resource management system 110 and clientdevice 102 may communicate with social network 112 and web site 114 overnetwork 104. In these illustrative examples, social network 112 may be aweb based application having event data 116 entered by users, such asuser 101. As depicted, event data 116 may comprise expression ofinterest about event 108. For example, one or more members of socialnetwork 112 may have previously entered event data 116 comprising anexpression of interest about event 108, such as an expression ofinterest about an aspect of an entity associated with event 108. Eventdata 116 may also comprise expression of interest about other past andcurrent events similar to event 108. Social network 112 may provideservices to search for, browse, enter, and modify event data 116.

In these illustrative examples, event repository 118 may be used incluster resource management environment 100 to store events. Events 120in event repository 118 may include past, current, and future events.For example, user 101 may use web browser 106 to enter event 108 intoevents 120. As another example, cluster resource management system 110may determine event 108 from event data 116 in social network 112. Asstill another example, event repository 118 may receive event 108 froman application in web site 114.

In these illustrative examples, web site 114 comprises content 122 andapplications 124 for event 108. Content 122 may comprise web pages,audio, video, pictures, documents, and any other type of content thatmay be provided to client applications 105 during event 108.Applications 124 of web site 114 run on a computer system such as a nodeof a cluster. Applications 124 may host sessions of client applications105 for delivering content 122. Applications 124 may also generatecontent 122. For example, subsequent to generation of a session for user101 for browsing web site 114 during event 108, instances ofapplications 124 may generate content 122 for the session and sendcontent 122 to web browser 106 for display on client device 102. As usedherein, a node of a cluster is a computer system, such as computersystem 128 in cluster of computer systems 126. Each node or computersystem in cluster of computer systems 126 may host one or more sessionswith one or more users for web site 114 during events, such as event108.

In these illustrative examples, computer system 128 within cluster ofcomputer systems 126 is a group of one or more computers. Also, as usedherein, “group of” when used with reference to items means one or moreitems. For example, group of computer systems is one or more computersystems. When computer system 128 is more than one computer, thecomputer system may take the form of a computer cluster, cluster ofcomputer systems 126, or other configurations of computer systemsconfigured to run server applications 130.

Cluster resource management system 110 uses sever applications 130located on computer system 128 in cluster of computer systems 126. Acomputer system is one or more computers in these illustrative examples.Server applications 130 may be any applications configured to processcommunications to provide services 132. Server applications 130 may be,for example, at least one of a database server, a file transfer protocol(FTP) server, a web server, a mail server, and/or other suitable typesof applications. Services 132 may include, for example, at least one ofretrieving a file, retrieving a webpage, retrieving information, writinginformation, downloading a program, and/or other suitable types ofaccess.

Cluster resource management system 110 may be implemented usinghardware, software, or a combination of the two. In these illustrativeexamples, cluster resource management system 110 is configured to managesentiment analysis using cluster of computer systems 126. In theseillustrative examples, cluster resource management system 110 isconfigured to use services 132 of server applications 130. For example,cluster resource management system 110 may use a service in services 132to perform analysis on event data 116 for each event in events 120. Asanother example, cluster resource management system 110 may use anotherservice in services 132 to generate and publish commands to allocateresources in cluster of computer systems 126 for content 122 andapplications 124 for event 108. In these illustrative examples, clusterresource management system 110 may be implemented as a server, such as aweb server, that is used by users for managing resources of clusters.

As depicted, cluster resource management system 110 may retrieve eventdata 116. In these illustrative examples, cluster resource managementsystem 110 may select a set of past events from events 120 that aresimilar to event 108. Cluster resource management system 110 may alsoanalyze information about event 108 in event data 116 and otherinformation about the set of past events in event data 116 to identify aportion of resources of one or more clusters required for use by event108.

The illustration of cluster resource management environment 100 in FIG.1 is not meant to imply physical or architectural limitations to themanner in which different illustrative embodiments may be implemented.Other components in addition to and/or in place of the ones illustratedmay be used. Some components may be unnecessary. Also, the blocks arepresented to illustrate some functional components. One or more of theseblocks may be combined and/or divided into different blocks whenimplemented in an illustrative embodiment.

For example, in some illustrative examples, additional social networks,in addition to social network 112, may be present within clusterresource management environment 100. Also, although cluster resourcemanagement system 110 is shown as a block separate from cluster ofcomputer systems 126, cluster resource management system 110 may beimplemented in computer system 128. In other examples, cluster resourcemanagement system 110 may be implemented in one or more computer systemsin cluster of computer systems 126.

Further, although social network 112, web site 114, and cluster resourcemanagement system 110 are shown in the block for cluster resourcemanagement environment 100 they may be remote from each other, such asby being in different locations. For example, social network 112 may belocated in a first physical location and web site 114 may be located ina second physical location different from the first physical location.

Turning next to FIG. 2, a block diagram of components involved inmanaging resources of clusters in a data processing system in a clusterresource management system is depicted in accordance with anillustrative embodiment. Cluster resource management system 200 is anexample of one implementation of cluster resource management system 110in cluster resource management environment 100 in FIG. 1.

In this illustrative example, data processing system 202 is present incluster resource management system 200. Data processing system 202 maybe any combination of hardware components implementing cluster resourcemanagement system 200. Data processing system 202 comprises clusterresource management services 204. In these illustrative examples,cluster resource management services 204 comprise a number of servicesthat manage resources of clusters. Preferences management 206 is aservice included in cluster resource management services 204 thatmanages profiles of users of cluster resource management system 200.

As depicted, profiles 208 include one or more profiles in clusterresource management system 200 of users of cluster resource managementsystem 200. In these illustrative examples, profile 210 is profile of auser located in profiles 208. Each profile in profiles 208 is an accountor other record of information for users of cluster resource managementsystem 200. In these illustrated examples, profiles, such as profile210, include preferences 212 of users of cluster resource managementsystem 200. Preferences 212 of users may be selected by a user, anadministrator, and by a rule using default preferences. Preferences 212include integration preferences 214 for using social networks, for usingevent repositories, and for hosting content and applications of websites. Preferences 212 also include polices 216 for identifying portionsof clusters required for use by events. In these illustrative examples,policies 216 include rules for using updates to data about currentevents, older data about the current events, and data about past eventsto calculate the portions of resources of clusters required for use byevents. For example, policies 216 may comprise a rule emphasizing use ofone of data about current events and data about past events. In thisexample, the rule may set a threshold for an age of data about pastevents, such as filtering out data that is an hour old, a day old, aweek old, and a year old, and other suitable time frames. In theseillustrative examples, the shorter time frames for filtering out dataare preferably used and provided for because using current data is moreindicative of current trends of members of social networks. Further inthis example, the rule may provide for a multiplier to use to asemphasis and/or de-emphasis for data about current events over olderdata about past events. In these illustrative examples, the multiplierselected by a user may be any real number from negative infinity topositive infinity.

In these illustrative examples, integration preferences 214 in profile210 include an identification of one or more servers, such as server218. Integration preferences 214 may also include an identification ofinformation for communicating with server 218. For example, theinformation for communicating with server 218 may, includeidentification of networking protocols used by server 218 over anetwork, such as network 220, identification of networking addresses ofserver 218 in network 220, identification of user names and passwordsfor gaining access to event data 222 in server 218, and any othersuitable information for communicating with server 218 in clusterresource management system 200.

In these illustrative examples, server 218 may host one or more websites, such as social network 112 and web site 114 in FIG. 1. Asdepicted, server 218 may include event data 222, such as eventinformation 226 from person 224. In these illustrative examples, eventinformation 226 may be used to identify interest in an event of personswho may attend an event, such as person 224. Event data 222 is anexample of event data 116 in FIG. 1. As depicted, network traffic 228may include data sent between users of collaboration tools over network220. In these illustrative examples, network traffic 228 may bemonitored by a data processing system, such as data processing system202. In these illustrative examples, event information 230 is an exampleof event data 116 in FIG. 1. In these illustrative examples, eventinformation 226 and event information 230 may comprise one or moresentiments about an event. For example, the sentiments in eventinformation 226 and event information 230 may comprise expressions ofpositive, negative, and neutral interest about aspects of entitiesassociated with the event.

Data search and retrieval 232 is a service included in cluster resourcemanagement services 204 that uses integration preferences 214 to searchfor and retrieve event information, such as event information 226 inserver 218 and event information 230 in network traffic 228. Data searchand retrieval 232 may also use integration preferences 214 to retrievecalendar entries associated with events from calendar server 234. Forexample, each of the calendar entries may comprise an indication that aparticular user intends to attend the event. In these illustrativeexamples, calendar server 234 may be an example of social network 112 inFIG. 1, an enterprise calendar server, and any other suitable source forcalendaring information in cluster resource management system 200.

Event repository 236 is a service included in cluster resourcemanagement services 204 for managing storage of data about events 238 indatabase 240. Event repository 236 is an example of event repository 118in FIG. 1. As depicted, events 238 include one or more events such asevent 242. In these illustrative examples, events 238 is an example ofevents 120 in FIG. 1 and event 242 is an example of event 108 in FIG. 1.

Cluster resource management 244 is a service included in clusterresource management services 204 for managing resources of clusters 246,such as resources 250 of cluster 248. In these illustrative examples,cluster resource management 244 may select a set of past events fromevents 238 that are similar to event 242. Cluster resource management244 may also analyze information about event 242 and other informationabout the set of past events to identify event resources of one or moreclusters required for use by event 242. For example, event resources 252may comprise one or more resources determined by cluster resourcemanagement 244 as needed for event 242 based on policies 216. Subsequentto identifying event resources 252, cluster resource management 244 maythen allocate event resources 252 for use by event 242.

As depicted, resource descriptions 254 comprise a description of one ormore types of resources of clusters 246. Resource 256 in resourcedescriptions 254 is an example of a particular type of resource 256 inclusters 246. For example, description of resource 256 includes type 258of resource 256 and startup delay 260 of resource 256. In this example,type 258 of resource may be a node in a cluster for hosting content andapplications of a web site for events, such as event 242. Further inthis example, startup delay 260 may be an amount of time required topower up resources of type 258.

In these illustrative examples, in a process for starting up resourcesfor use by event 242, cluster resource management 244 may retrievestartup delay 260 for each resource in event resources 252. Clusterresource management 244 may next calculate a time when each of theresources in event resources 252 needs to be powered up based on startupdelay 260 of each respective resource in event resources 252. Clusterresource management 244 may then generate and send commands, such ascommand 262, to clusters 246 for powering up each of the resources inevent resources 252 at the time for which each resource needs to powerup for use by event 242.

The illustration of cluster resource management environment 200 in FIG.2 is not meant to imply physical or architectural limitations to themanner in which different illustrative embodiments may be implemented.Other components in addition to and/or in place of the ones illustratedmay be used. Some components may be unnecessary. Also, the blocks arepresented to illustrate some functional components. One or more of theseblocks may be combined and/or divided into different blocks whenimplemented in an illustrative embodiment.

For example, in some illustrative examples, additional services, inaddition to the services shown cluster resource management services 204,may be present within cluster resource management system 200. Forexample, a service in services 132 in FIG. 1 to authorize computingdevices such as client device 102 in FIG. 1 may be included in clusterresource management system 200. In this example, the authorization ofclient device 102 may be required by a policy in policies 216 beforeclient device 102 is allowed access to events 238.

As another example, a service in cluster resource management services204 in FIG. 2 to generate report 264 showing electrical power savingsand/or cost savings may be included in cluster resource managementsystem 200. In this example, the service to generate report 264 mayexecute on an intermittent basis or based on a receipt of a request togenerate report 264. Further in this example, report 264 may include asavings calculated based on a difference between resource use ofclusters during similar prior events that were not performed usingcluster resource management system 200 and resource use of clusters fora current event that was performed using cluster resource managementsystem 200.

Turning now to FIG. 3, an illustrative example of a flowchart of aprocess for managing allocations of resources of clusters is depicted inaccordance with an illustrative embodiment. The steps in FIG. 3 may beimplemented by cluster resource management system 200 in FIG. 2. Inparticular, the steps in the process may be implemented in software,hardware, or a combination of the two in cluster resource managementservices 204 in data processing system 202 in FIG. 2.

The process begins by retrieving data about an event and other dataabout past events (step 300). In this illustrated process, the dataabout an event and other data about past events are examples of eventdata 222 in FIG. 2 and the event is an example of event 242 in FIG. 2.The process next selects a set of past events that are similar to theevent, based on the data about the event and the other data about thepast events (step 302).

The process then analyzes the data about the event and the other dataabout the past events associated with the set of past events to identifya portion of resources of one or more clusters required for use by theevent (step 304). Responsive to identifying the portion of the resourcesof the one or more clusters required for use by the event (step 306),the process allocates, for the event, the portion of the resources ofthe clusters required for use by the event (step 308) with the processterminating thereafter.

Turning next to FIG. 4, an illustrative example of a flowchart of aprocess for managing re-allocations of resources of clusters is depictedin accordance with an illustrative embodiment. The steps in FIG. 4 maybe implemented by cluster resource management system 200 in FIG. 2. Inparticular, the steps in the process may be implemented in software,hardware, or a combination of the two in cluster resource managementservices 204 in data processing system 202 in FIG. 2.

The process begins by retrieving updates to data about an event, whereinthe event is identified as using a first portion of resources of one ormore clusters, and wherein the first potion of resources is allocatedfor the event (step 400). In this illustrated process, the updates todata about an event and other data about past events are examples ofevent data 222 in FIG. 2, the event is an example of event 242 in FIG.2, and the first portion of resources of one or more clusters is anexample of event resources 252 in FIG. 2.

The process next analyzes the updates to the data about the event,previous data about the event, and other data about past eventsassociated with a set of past events that are similar to the event toidentify a second portion of the resources of the one or more clustersrequired for use by the event (step 402). The process then determines ifa difference exists between the first portion and second portion (step404).

Responsive to a determination that the difference exists in (step 406),the process continues by re-allocating the resources of the one or moreclusters for use by the event based on the difference between the firstportion and second portion (step 408) and then sending commands to theone or more clusters for powering down each of the resources in thefirst portion that are not in the second portion (step 410).

The process then determines if there are any more updates to data aboutthe event (step 412). As depicted in step 414, responsive to the processidentifying that there are more updates, the process goes back to step400, otherwise if there are no more updates, the process terminates.

Turning next to FIG. 5, an illustrative example of a flowchart of aprocess for managing allocations of resources of clusters usingpreferences is depicted in accordance with an illustrative embodiment.The steps in FIG. 5 may be implemented by cluster resource managementsystem 200 in FIG. 2. In particular, the steps in the process may beimplemented in software, hardware, or a combination of the two incluster resource management services 204 in data processing system 202in FIG. 2.

The process begins by retrieving data about an event, other data aboutpast events, and a preference emphasizing use of one of data aboutcurrent events and data about past events (step 500). In thisillustrated process, the data about an event and other data about pastevents are examples of event data 222 in FIG. 2, the event is an exampleof event 242 in FIG. 2, the preference is an example of a preference inpolicies 216 in FIG. 2, and the clusters is an example of clusters 246in FIG. 2.

The process selects a set of past events that are similar to the event,based on the data about the event and the other data about the pastevents (step 502). The process next analyzes the data about the eventand the other data about the past events associated with the set of pastevents to identify a portion of resources of one or more clustersrequired for use by the event, wherein the identification comprisesusing the retrieved preference to calculate the portion of the resourcesof the one or more clusters required for use by the event (step 504).

Responsive to the identification of the portion of the resources of theone or more clusters required for use by the event, the processallocates, for the event, the portion of the resources of the one ormore clusters required for use by the event (step 508) with the processterminating thereafter.

Turning next to FIG. 6, an illustrative example of a flowchart of aprocess for powering up resources of clusters for an event is depictedin accordance with an illustrative embodiment. The steps in FIG. 6 maybe implemented by cluster resource management system 200 in FIG. 2. Inparticular, the steps in the process may be implemented in software,hardware, or a combination of the two in cluster resource managementservices 204 in data processing system 202 in FIG. 2.

The process begins by retrieving an amount of time required to power upeach resource in a portion of resources of one or more clusters requiredfor use by an event (step 600). The process next calculates a time wheneach of the resources in the portion of the resources needs to bepowered up based on the amount of time required to power up eachrespective resource (step 602). The process then sends commands to theone or more of the clusters for powering up each of the resources in theportion of the resources at the time for which each resource needs topower up for use by the event (step 604) with the process terminatingthereafter.

Turning now to FIG. 7, an illustration of a data processing system isdepicted in accordance with an illustrative embodiment. Data processingsystem 700 is an example of a data processing system that may be used toimplement managing resources of clusters in a cluster resourcemanagement system. Data processing system 700 is also an example of adata processing system that may be used to implement client device 102in FIG. 1, cluster resource management system 110 in FIG. 1, andcomputer system 128 in FIG. 1. More particularly, data processing system700 may be used to implement data processing system 202 in FIG. 2 andserver 218 in FIG. 2. In this illustrative example, data processingsystem 700 includes communications framework 702, which providescommunications between processor unit 704, memory 706, persistentstorage 708, communications unit 710, input/output (I/O) unit 712, anddisplay 714. In these examples, communications frame work 702 may be abus system.

Processor unit 704 serves to execute instructions for software that maybe loaded into memory 706. Processor unit 704 may be a number ofprocessors, a multi-processor core, or some other type of processor,depending on the particular implementation. A number, as used hereinwith reference to an item, means one or more items. Further, processorunit 704 may be implemented using a number of heterogeneous processorsystems in which a main processor is present with secondary processorson a single chip. As another illustrative example, processor unit 704may be a symmetric multi-processor system containing multiple processorsof the same type.

Memory 706 and persistent storage 708 are examples of storage devices716. A storage device is any piece of hardware that is capable ofstoring information, such as, for example, without limitation, data,program code in functional form, and/or other suitable informationeither on a temporary basis and/or a permanent basis. Storage devices716 may also be referred to as computer readable storage devices inthese examples. Memory 706, in these examples, may be, for example, arandom access memory or any other suitable volatile or non-volatilestorage device. Persistent storage 708 may take various forms, dependingon the particular implementation.

For example, persistent storage 708 may contain one or more componentsor devices. For example, persistent storage 708 may be a hard drive, aflash memory, a rewritable optical disk, a rewritable magnetic tape, orsome combination of the above. The media used by persistent storage 708also may be removable. For example, a removable hard drive may be usedfor persistent storage 708.

Communications unit 710, in these examples, provides for communicationswith other data processing systems or devices. In these examples,communications unit 710 is a network interface card. Communications unit710 may provide communications through the use of either or bothphysical and wireless communications links.

Input/output unit 712 allows for input and output of data with otherdevices that may be connected to data processing system 700. Forexample, input/output unit 712 may provide a connection for user inputthrough a keyboard, a mouse, and/or some other suitable input device.Further, input/output unit 712 may send output to a printer. Display 714provides a mechanism to display information to a user.

Instructions for the operating system, applications, and/or programs maybe located in storage devices 716, which are in communication withprocessor unit 704 through communications framework 702. In theseillustrative examples, the instructions are in a functional form onpersistent storage 708. These instructions may be loaded into memory 706for execution by processor unit 704. The processes of the differentembodiments may be performed by processor unit 704 using computerimplemented instructions, which may be located in a memory, such asmemory 706.

These instructions are referred to as program code, computer usableprogram code, or computer readable program code that may be read andexecuted by a processor in processor unit 704. The program code in thedifferent embodiments may be embodied on different physical or computerreadable storage media, such as memory 706 or persistent storage 708.

Program code 718 is located in a functional form on computer readablemedia 720 that is selectively removable and may be loaded onto ortransferred to data processing system 700 for execution by processorunit 704. Program code 718 and computer readable media 720 form computerprogram product 722 in these examples. In one example, computer readablemedia 720 may be computer readable storage media 724 or computerreadable signal media 726. Computer readable storage media 724 mayinclude, for example, an optical or magnetic disk that is inserted orplaced into a drive or other device that is part of persistent storage708 for transfer onto a storage device, such as a hard drive, that ispart of persistent storage 708. Computer readable storage media 724 alsomay take the form of a persistent storage, such as a hard drive, a thumbdrive, or a flash memory, that is connected to data processing system700. In some instances, computer readable storage media 724 may not beremovable from data processing system 700. In these examples, computerreadable storage media 724 is a physical or tangible storage device usedto store program code 718 rather than a medium that propagates ortransmits program code 718. Computer readable storage media 724 is alsoreferred to as a computer readable tangible storage device or a computerreadable physical storage device. In other words, computer readablestorage media 724 is a media that can be touched by a person.

Alternatively, program code 718 may be transferred to data processingsystem 700 using computer readable signal media 726. Computer readablesignal media 726 may be, for example, a propagated data signalcontaining program code 718. For example, computer readable signal media726 may be an electromagnetic signal, an optical signal, and/or anyother suitable type of signal. These signals may be transmitted overcommunications links, such as wireless communications links, opticalfiber cable, coaxial cable, a wire, and/or any other suitable type ofcommunications link. In other words, the communications link and/or theconnection may be physical or wireless in the illustrative examples.

In some illustrative embodiments, program code 718 may be downloadedover a network to persistent storage 708 from another device or dataprocessing system through computer readable signal media 726 for usewithin data processing system 700. For instance, program code stored ina computer readable storage medium in a server data processing systemmay be downloaded over a network from the server to data processingsystem 700. The data processing system providing program code 718 may bea server computer, a client computer, or some other device capable ofstoring and transmitting program code 718.

The different components illustrated for data processing system 700 arenot meant to provide architectural limitations to the manner in whichdifferent embodiments may be implemented. The different illustrativeembodiments may be implemented in a data processing system includingcomponents in addition to or in place of those illustrated for dataprocessing system 700. Other components shown in FIG. 7 can be variedfrom the illustrative examples shown. The different embodiments may beimplemented using any hardware device or system capable of runningprogram code. As one example, the data processing system may includeorganic components integrated with inorganic components and/or may becomprised entirely of organic components excluding a human being. Forexample, a storage device may be comprised of an organic semiconductor.

In another illustrative example, processor unit 704 may take the form ofa hardware unit that has circuits that are manufactured or configuredfor a particular use. This type of hardware may perform operationswithout needing program code to be loaded into a memory from a storagedevice to be configured to perform the operations. For example, whenprocessor unit 704 takes the form of a hardware unit, processor unit 704may be a circuit system, an application specific integrated circuit(ASIC), a programmable logic device, or some other suitable type ofhardware configured to perform a number of operations. With aprogrammable logic device, the device is configured to perform thenumber of operations. The device may be reconfigured at a later time ormay be permanently configured to perform the number of operations.Examples of programmable logic devices include, for example, aprogrammable logic array, a programmable array logic, a fieldprogrammable logic array, a field programmable gate array, and othersuitable hardware devices. With this type of implementation, programcode 718 may be omitted because the processes for the differentembodiments are implemented in a hardware unit.

In still another illustrative example, processor unit 704 may beimplemented using a combination of processors found in computers andhardware units. Processor unit 704 may have a number of hardware unitsand a number of processors that are configured to run program code 718.With this depicted example, some of the processes may be implemented inthe number of hardware units, while other processes may be implementedin the number of processors.

In another example, a bus system may be used to implement communicationsframework 702 and may be comprised of one or more buses, such as asystem bus or an input/output bus. Of course, the bus system may beimplemented using any suitable type of architecture that provides for atransfer of data between different components or devices attached to thebus system.

Additionally, a communications unit may include a number of more devicesthat transmit data, receive data, or transmit and receive data. Acommunications unit may be, for example, a modem or a network adapter,two network adapters, or some combination thereof. Further, a memory maybe, for example, memory 706, or a cache, such as found in an interfaceand memory controller hub that may be present in communicationsframework 702.

Thus, the illustrative embodiments provide a method, data processingsystem, and computer program product for managing resources of clusters.In one example, a program runs in a computer system and managesresources of clusters. In this example, the program retrieves data aboutan event and other data about past events. The program selects a set ofpast events that are similar to the event, based on the data about theevent and the other data about the past events. The program thenanalyzes the data about the event and the other data about the pastevents associated with the set of past events to identify a portion ofthe resources of one or more of the clusters required for use by theevent. In another example, the program generates and sends commands toclusters to power down resources that are not needed for use by an eventbased in part on recent information provided by member of a socialnetwork. In still another example, the program generates and sendscommands to clusters to power up resources needed for use by the eventbased on an amount of time required to power up each respectiveresource.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a,” “an,” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components but do not preclude the presence or addition of one ormore other features, integers, steps, operations, elements, components,and/or groups thereof.

The flowcharts and block diagrams in the figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowcharts or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be performed substantiallyconcurrently, or the blocks may sometimes be performed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustrations,and combinations of blocks in the block diagrams and/or flowchartillustrations, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

What is claimed is:
 1. A method for managing resources of clusters, themethod comprising: retrieving, by a computer, data about an event andother data about past events; selecting, by the computer, a set of pastevents that are similar to the event, based on the data about the eventand the other data about the past events; analyzing, by the computer,the data about the event and the other data about the past eventsassociated with the set of past events to identify a portion of theresources of one or more of the clusters required for use by the event.2. The method of claim 1, further comprising: allocating, by thecomputer, the portion of the resources of the one or more of theclusters required for use by the event.
 3. The method of claim 2,wherein the portion of the resources is a first portion and furthercomprising: receiving, by the computer, updates to the data about theevent; analyzing, by the computer, the updates to the data about theevent, the data about the event, and the other data about the pastevents associated with the set of past events to identify a secondportion of the resources of the one or more of the clusters required foruse by the event; determining, by the computer, if a difference existsbetween the first portion and second portion, and if so, the computerre-allocating the resources of the one or more of the clusters for useby the event based on the difference between the first portion andsecond portion.
 4. The method of claim 3, further comprising: sending,by the computer, commands to the one or more of the clusters forpowering down each of the resources in the first portion that are not inthe second portion.
 5. The method of claim 1, further comprising:retrieving, by the computer, an amount of time required to power up eachof the resources in the portion of the resources of the one or more ofthe clusters required for use by the event; calculating, by thecomputer, a time when each of the resources in the portion of theresources needs to be powered up based on the amount of time required topower up each respective resource; and sending, by the computer,commands to the one or more of the clusters for powering up each of theresources in the portion of the resources at the time for which eachresource needs to power up for use by the event.
 6. The method of claim1, wherein the data about the event includes a start time for the event,a duration of the event, and an event type, and wherein the other dataabout the past events includes an amount of resources used by each ofthe past events, start times for each of the past events, durations ofeach of the past events, and event types of each of the past events. 7.The method of claim 1, wherein analyzing, by the computer, the dataabout the event and the other data about the past events associated withthe set of past events to identify the portion of the resources of theone or more of the clusters required for use by the event furthercomprises: using a preference for using data about current events andthe other data about the past events to calculate the portion of theresources of the one or more of the clusters required for use by theevent.
 8. The method of claim 3, wherein analyzing, by the computer, theupdates to the data about the event, the data about the event, and theother data about the past events associated with the set of past eventsto identify the second portion of the resources of the one or more ofthe clusters required for use by the event further comprises: using apreference for using updates to data about current events, older dataabout the current events, and the other data about the past events tocalculate the portion of the resources of the one or more of theclusters required for use by the event.
 9. The method of claim 7,wherein the preference emphasizes using one of data about current eventsand the other data about the past events.
 10. The method of claim 1,wherein the data about the event and the other data about the pastevents comprise numbers of people attending the event and the pastevents extracted from, but not limited to, social media, internettraffic, and calendar information.